On solutions of Kolmogorov’s equations for nonhomogeneous jump Markov processes
نویسندگان
چکیده
Article history: Received 23 February 2013 Available online 27 September 2013 Submitted by U. Stadtmueller
منابع مشابه
Sufficiency of Markov Policies for Continuous-Time Markov Decision Processes and Solutions of Forward Kolmogorov Equation for Jump Markov Processes
In continuous-time Markov decision processes (CTMDPs) with Borel state and action spaces, unbounded transition rates, for an arbitrary policy, we construct a relaxed Markov policy such that the marginal distribution on the stateaction pairs at any time instant is the same for both the policies. This result implies the existence of a relaxed Markov policy that performs equally to an arbitrary po...
متن کاملOn $L_1$-weak ergodicity of nonhomogeneous continuous-time Markov processes
In the present paper we investigate the $L_1$-weak ergodicity of nonhomogeneous continuous-time Markov processes with general state spaces. We provide a necessary and sufficient condition for such processes to satisfy the $L_1$-weak ergodicity. Moreover, we apply the obtained results to establish $L_1$-weak ergodicity of quadratic stochastic processes.
متن کاملApplied Probability
1 Basic aspects of continuous time Markov chains 3 1.1 Markov property . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 1.2 Regular jump chain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 1.3 Holding times . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 1.4 Poisson process . . . . . . . . . . . . . . ....
متن کاملHarnack inequalities for jump processes
We consider a class of pure jump Markov processes in R whose jump kernels are comparable to those of symmetric stable processes. We establish a Harnack inequality for nonnegative functions that are harmonic with respect to these processes. We also establish regularity for the solutions to certain integral equations.
متن کاملDiscrete-space partial dynamic equations on time scales and applications to stochastic processes
We consider a general class of discrete-space linear partial dynamic equations. The basic properties of solutions are provided (existence and uniqueness, sign preservation, maximum principle). Above all, we derive the following main results: first, we prove that the solutions depend continuously on the choice of the time scale. Second, we show that, under certain conditions, the solutions descr...
متن کامل